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(57) Abstract: In a near-instantaneously adaptive joint-detection CDMA-based transceiver used for wireless video telephony a 
method for transmission of a multimedia signal is described, the method comprising: providing a transmitter operable to transmit 
in a plurality of modulation modes varying in bit rate and error resilience between a highest bit rate, lowest error resilience mode 
and a lowest bit rate, highest error resilience mode; obtaining a channel quality measure for current transmission; and switching to a 
more or less error resilient modulation mode each time the channel quality measure respectively degrades or improves by a defined 
amount, whereby multimedia signal quality varies smoothly with varying channel quality of the transmission medium. 
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ADAPTIVE JOINT-DETECTION COMA VIDEO TRANSCEIVER 



4 1 Background of the Invention 

s The invention relates to burst-by-burst adaptive joint-detection Code Division Multiple Access (CDMA) 
b based transmission of multimedia signals, such as interactive video or audio, speech etc. 
7 In contrast to the burst-by-burst reconfigurable CDMA multimedia transceivers described in this doc- 
a ument, the term statically reconfigurable found in this context in the literature refers to multimedia 
9 transceivers that cannot be near-instantaneously reconfigured. More explicitly, the previously proposed 
to statically reconfigurable video transceivers were reconfigured on a long-term basis under the base sta- 
ll tion's control, invoking for example in the central cell region - where benign channel conditions prevail 

12 - a less robust, but high-throughput modulation mode, such as 4 bit/symbol Quadrature Amplitude Mod- 

13 ulation (16QAM), which was capable of transmitting a quadruple number of bits and hence ensured a 

14 better video quality. By contrast, a robust, but low-throughput modulation mode, such as 1 bit/symbol 
is Binary Phase Shift Keying (BPSK) can be employed near the edge of the propagation cell, where hostile 
is propagation conditions prevail. This prevented a premature hand-over at the cost of a reduced video 
it quality. 

ta The philosophy of the fixed, but programable-rate proprietary video codecs and statically reconfigurable 

is multi-mode video transceivers presented by Streit et al for example in References [I] was that irrespec- 

20 tive of the video motion activity experienced, the specially designed video codecs generated a constant 

21 number of bits per video frame. For example, for videophony over the second-generation Global System 

22 of Mobile Communications known as the GSM system at 13 kbps and assuming a video scanning rate of 
zs 10 frames/s, 1300 bits per video frame have to be generated. Specifically, two families of video codecs 
24 were designed, one refraining from using error-sensitive run-length coding techniques and exhibiting the 
2s highest possible error resilience and another, aiming for the highest possible compression ratio. This 
zs fixed-rate approach had the advantage of requiring no adaptive feedback controlled bitrate fluctuation 
27 smoothing buffering and hence exhibited no objectionable video latency or delay. Furthermore, these 
re video codecs were amenable to video telephony over fixed-rate second-generation mobile radio systems, 
29 such as the GSM. 

M The fixed bitrate of the above proprietary video codecs is in contrast to existing standard video codecs, 
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31 such as the Motion Pictures Expert Group codecs known as MPEG I and MPEG2 or the ITU's H.263 

32 codec, where the time-variant video motion activity and the variable-length coding techniques employed 

33 result in a time- variant bitrate fluctuation and a near-constant perceptual video quality. This time- variant 

34 bitrate fluctuation can be mitigated by employing adaptive feed-back controlled buffering, which po- 

35 tentially increases the latency or delay of the codec and hence it is often objectionable for example in 

36 interactive videophony. The schemes presented by Streit et at. in References [1] result in slightly variable 

37 video quality at a constant bitrate, while refraining from employing buffering, which again, would result 
3a in latency in interactive videophony. A range of techniques, which can be invoked, in order to render the 
39 family of variable- length coded, highly bandwidth-efficient, but potentially error-sensitive class of stan- 
ce dard video codecs, such as the H.263 arrangement, amenable to error-resilient, low-latency interactive 
4t wireless multimode videophony was summarised in [2]. The adaptive video rate control and packetisa- 
*2 don algorithm of [2] generates the required number of bits for the burst- by -burst adaptive transceiver, 

43 depending the on the capacity of the current packet, as determined by the current modem mode. Fur- 

44 ther error-resilient H.263-based schemes were contrived for example by Farber, Steinbach and Girod 

45 at Erlangen University [3], while Sadka, Eryurtlu and Kondoz [4] from Surrey University proposed a 
4€ range of improvements to the H.263 scheme. Following the above portrayal of the prior art in both video 
47 compression and statically reconfigurable narroband modulation, let us now consider the philosophy of 

-48 : wideband burst-by -burst adaptive quadrature amplitude modulation (AQAM) in more depth. 

. In burst-by-burst adaptive modulation a higher-order modulation scheme is invoked, when the channel 

so is favourable, in order to increase the system's bits per symbol capacity and conversely, a more robust 

-st lower-order modulation scheme is employed, when the channel exhibits inferior channel quality, in order 

S2 to improve the mean Bit Error Ratio (BER) performance. A practical scenario, where adaptive modular 

i3 tion can be applied is, when a reliable, low-delay feedback path is created between the transmitter and 

54 receiver, for example by superimposing the estimated channel quality perceived by the receiver on the 

ss reverse-direction messages of a duplex interactive channel. The transmitter then adjusts its modem mode 

56 according to this perceived channel quality, 

57 Recent developments in adaptive modulation over a narrow-band channel environment have been pi- 
se oneered by Webb and Steele [5], where the modulation adaptation was utilized in a Digital European 
59 Cordless Telephone - like (DECT) system. The concept of variable rate adaptive modulation was also 
so advanced by Sampei et al [6], showing promising advantages, when compared to fixed modulation in 
si terms of spectral efficiency, BER performance and robustness against channel delay spread. In another 

62 paper, the numerical upper bound performance of adaptive modulation in a slow Rayieigh flat-fading 

63 channel was evaluated by Torrance et al[7] and subsequently, the optimization of the switching threshold 
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64 levels using Powell minimization was used in order to achieve a targeted performance [S, 9]. In addition. 

*s adaptive modulation was also studied in conjunction with channel coding and power control techniques 

« by Matsuoka et al [6J as well as Goldsmith et aL[\0]. 

67 In the narrow-band channel environment, the quality of the channel was determined by the short term 

sa Signal to Noise Ratio (SNR) of the received burst, which was then used as a criterion in order to choose 

so the appropriate modulation mode for the transmitter, based on a list of switching threshold levels, /„ [5. 9] 

70 However, in a wideband environment, this criterion is not an accurate measure forjudging the quality of 

rt the channel, where the existence of multi-path components produces not only power attenuation of the 

72 transmission burst, but also intersymbo! interference. Subsequently, a new criterion has to be defined to 

73 estimate the wideband channel quality in order to choose the appropriate modulation scheme. 

7* 2 Summary of the Invention 

7s Particular and preferred aspects of the invention are set out in the accompanying independent and depen- 
7s dent claims. Features of the dependent claims may be combined with those of the independent claims as 
77 appropriate and used in combinations other than those explicitly set out in the claims. 
7s The performance benefits of burst-by-burst adaptive modulation assisted CDMA are described, employ- 
re ing a higher-order modulation mode in transmission bursts, when the instantaneous channel quality is 
ao favourable, ie when the received signal is unimpaired by co-channel interferers. This procedure is em- 
si ployed, in order to increase the system's bits per symbol (BPS) capacity and conversely, invoking a more 
82 robust, lower order modulation mode, when the channel exhibits inferior channel quality. Therefore the 
63 associated bit rate will be time- variant. 

* It is shown that due to the described adaptive modem mode switching regime a seamless multimedia 
as source-signal representation quality - such as video or audio quality - versus channel quality relation- 
es ship can be established, resulting in a near-unimpaired multimedia source-signal quality right across 
67 the operating channel Signal -to-Noise Ratio (SNR) range. The main advantage of the described tech- 
sa nique is that irrespective of the prevailing channel conditions, the transceiver achieves always the best 
as possible source-signal representation quality - such as video or audio quality - by automatically adjust- 
so ing the achievable bitrate and the associated multimedia source-signal representation quality in order to 

91 match the channel quality experienced. This can achieved on a near- instantaneous basis under given 

92 propagation conditions in order to cater for the effects of path-loss, fast-fading, slow-fading, dispersion, 

93 co-channel interference, etc. Furthermore, when a mobile is roaming in a hostile out-doors - or even 

94 hilly terrain - propagation environment, typically low-order, low-rate modem modes are invoked, while 
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as in benign indoor environments predominantly the high-rate, high source-signal representation quality 

w modes are employed. 

97 3 Brief Description of the Drawings 

93 For a better understanding of the invention and to show how the same may be carried into effect reference 

99 is now made by way of example to the accompanying drawings, in which; 

100 List of Figures 

toi 1 Signalling scenarios in adaptive modems 19 

* -12 2 Reconfigurabie transceiver schematic 20 

.03 3 Transmission burst structure of the FMA1 spread speech/data mode 2 of the FRAMES 

iw proposaifll] 20 

io5 4 Normalized channel impulse response for the COST 207 seven-path Bad Urban channel. 21 

ids 5 BER versus channel SNR 4QAM performance using BCH coded 13.7Kbps video, com- 

107 paring the performance of matched filtering and joint detection for 2-8 users 21 

108 6 BER versus channel SNR 4QAM performance using turbo-coded 1 1.1Kbps video, com- 

109 paring the performance of matched filtering and joint detection for 2—8 users 22 

no 7 Video packet loss ratio versus channel SNR for the turbo-coded 11.1 Kbps video stream, 

in comparing the performance of matched filtering and joint detection for 2-8 users 22 

112 8 Video packet loss ratio (PLR) and feedback error ratio (FBER) versus channel SNR for 

in the three modulation schemes of the 2-user multi-mode system using joint detection. . . 23 

iw 9 Decoded video quality (PSNR) versus channel SNR for the modulation modes of BPSK, 

us 4QAM and 16QAM supporting 2-users with the aid of joint detection. These results 

us were recorded for the Miss-America video sequence at SQCIF resolution (128x96 pels). 23 

u7 10 Decoded video quality (PSNR) versus video packet loss ratio for the modulation modes 

us of BPSK, 4QAM and 16QAM, supporting 2-users with the aid of joint detection. The 

M9 results were recorded for the Miss-America video sequence at SQCIF resolution (128x96 

120 pels) . , 24 

121 1 1 Example of modem mode switching in a dynamically reconfigured burst-by-burst mo- 

122 dem in operation, where the modulation mode switching is based upon the SINR estimate 
at the output of the joint-detector. 24 



123 
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12* 12 PDF of the various adaptive modem modes versus channel SNR 25 

«zs 1 3 Throughput bitrate versus channel SNR comparision of the three fixed modulation modes 

•26 (BPSIC, 4QAM, 16QAM) and the adaptive burst-by-burst modem (AQAM), both sup- 

'27 porting 2 users with the aid of joint detection 25 

'2a 14 Average decoded video quality (PSNR) versus channel SNR comparision of the fixed 

129 modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 
dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

«3» for the Miss- America video sequence at SQCP? resolution (128x96 pels) 26 

'32 15 Video packet loss ratio (PLR) versus channel SNR for the three modulation schemes of 

133 the multi-mode system, compared to the burst-by -burst adaptive modem. Both systems 

t:* substain 2-users using joint detection. 26 

-as 16 Decoded video quality (PSNR) versus video packet loss ratio comparision of the fixed 

136 modulation modes of BPSK, 4QAM and 16QAM, and the burst-by-burst adaptive mo- 

'37 dem. Both supporting 2-users with the aid of joint detection. These results were recorded 

>3a for the Miss-America video sequence at SQCDF resolution (128x96 pels) 27 
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.39 3.1 State-of-the-art 

i*o Burst-by-burst adaptive quadrature amplitude modulation (AQAM) was contrived by Steele and Webb [5] 

ui in order for the transceiver to cope with the time-variant channel quality of narrowband fading channels. 

i*2 Further related research was conducted at the University of Osaka by Sampei and his colleagues, investi- 

i4o gating variable coding rate concatenated coded schemes [6], at the University of Stanford by Goldsmith 

144 and her team, studying the effects of variable-rate, variable -power arrangements [10] and at Southamp- 

Ms ton University in the UK, investigating a variety of practical aspects of AQAM [12, 13]. The channel's 

146 quality is estimated on a burst-by-burst basis and the most appropriate modulation mode is selected in or- 

147 der to maintain the required target bit error rate (BER) performance, whilst maximizing the system's Bit 
i*a Per Symbol (BPS) throughput. Using this reconfiguration regime the distribution of channel errors be- 
« comes typically less bursty, than in conjunction with non-adaptive modems, which potentially increases 
.sa the channel coding gains. Furthermore, the soft-decision channel codec metrics can be also invoked in 
isi estimating the instantaneous channel quality, irrespective of the type of channel impairments. 

152 A range of coded AQAM schemes were analysed by Matsuoka et al [6], Lau et al [14] and Gold- 

is3 smith et al [10]. For data transmission systems, which do not necessarily require a low transmission 

is4 delay, variable-throughput adaptive schemes can be devised, which operate efficiently in conjunction 

is5 with powerful error correction codecs, such as long block length turbo codes. However, the acceptable 

is6 turbo interleaving delay is rather low in the context of low-delay interactive speech. Video communica- 

is7 tions systems typically require a higher bitrate than speech systems and hence they can afford a higher 

isa interleaving delay. 

is9 The above principles - which were typically investigated in the context of narrowband modems - were 

160 further advanced in conjunction with wideband modems, employing powerful block turbo coded wide- 

161 band Decision Feedback Equaliser (DFE) assisted AQAM transceivers [15]. A neural- network Radial 
tar Basis Function (RBF) DFE based AQAM modem design was proposed in [16], where the RJBF DFE 
163 provided the channel quality estimates for the modem mode switching regime. This modem was capa- 
iw ble of removing the residual BER of conventional DFEs, when linearly non-separable received phasor 
i6s constellations were encountered. 

i6s The above burst-by- burst adaptive principles can also be extended to Adaptive Orthogonal Frequency 

t67 Division Multiplexing (AOFDM) schemes [17]. The associated AQAM principles were invoked in the 

isa context of parallel AOFDM modems also by Czylwik et al [18], Fischer [19] and Chow et al [20]. 

tea Our main contribution is that upon invoking the technique advocated - irrespective of the channel con- 

iro ditions experienced - the transceiver achieves always the best possible video quality by automatically 
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m adjusting the achievable bitrate and the associated video quality in order to match the channel quality ex- 

172 perienced. This is achieved on a near-instantaneous basis under given propagation conditions in order to 

in cater for the effects of path- loss, fast-fading, slow-fading, dispersion, co-channel interference, etc. Fur- 

17* thermore, when the mobile is roaming in a hostile outdoor propagation environment, typically low-order. 

175 low-rate modem modes are invoiced, while in benign indoor environments predominantly the high-rate, 

176 high source-signal representation quality modes are employed. 

in 3.2 ACDMA Signalling Scenarios 

178 ACDMA transmission parameter adaptation is an action of the transmitter in response to time-varying 

179 channel conditions. It is only suitable for duplex communication between two stations, since the trans- 
teo mission parameter adaptation relies on some form of channel estimation and signalling. In order to 
iat efficiently react to the changes in channel quality, the following steps have to be taken: 



t82 • Channel quality estimation: In order to appropriately select the transmission parameters to be 

lea employed for the next transmission, a reliable prediction of the channel quality during the next 
active transmit timeslot is necessary. 

ies • Choice of the appropriate parameters for the next transmission: Based on the prediction of the 

ias expected channel conditions during the next timeslot, the transmitter has to select the appropriate 

w modulation schemes for the subcarriers. 

tea • Signalling or blind detection of the employed parameters: The receiver has to be informed, as 

i89 to which set of demodulator parameters to employ for the received packet. This information can 

teo either be conveyed within the packet, at the cost of loss of useful data bandwidth, or the receiver 

Wt can attempt to estimate the parameters employed at the transmitter by means of blind detection 

in mechanisms. 



193 Depending on the channel characteristics, these operations can be performed at either of the duplex 

194 stations, as shown in Figures 1(a), 1(b) and 1(c). If the channel is reciprocal, then the channel quality 

195 estimation for each link can be extracted from the reverse link, and we refer to this regime as open- 
toe loop adaptation. In this case, the transmitter needs to communicate the transmission parameter set to 

197 the receiver (Figure 1(a)), or the receiver can attempt blind detection of the transmission parameters 

198 employed (Figure 1(c)). 

t»9 If the channel is not reciprocal, then the channel quality estimation has to be performed at the receiver 

a» of the link. In this case, the channel quality measure or the set of requested transmission parameters is 
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201 communicated to the transmitter in the reverse link (Figure 1(b)). This mode is referred to as closed-loop 

202 adaptation. 

3.3 Video Transceiver 

2(w The schematic of the whole system is depicted in Figure 2. The multimedia source signal generated by 

205 the video encoder of Figure 2 is assembled into transmission packets constituting a CDMA transmission 

2M burst and the bits may be additionally mapped by the Mapper of Figure 2 to n number of different 

so? Forward Error Correction (FEC) protection classes. These bits are then convenveyed to the optional 

we Time Division Multiplex (TDMA)/ Time Division Duplex (TDD) scheme of Figure 2, before they are 

209 assigned to the AQAM/ACDMA modem seen in Figure 2. 

. 210 Again, the philosophy of the proposed burst-by-burst adaptive joint detection CDMA scheme is that the 

.iu signal to interference plus noise ratio (SINR) at the output of the multi-user receiver is used in order to 

2»2 estimate the instantaneous channel quality. In one of its possible embodiments the receiver then decides 

2ta on the transmitter's mode to be used during the next transmission burst on the basis of the received signal 

21* quality and the receiver's perception of the channel quality is signalled to the remote transmitter, in order 

2is to allow it to satisfy the receiver's integrity requirement. 

2i6^ Irrthis study we transmitted 176x144 pixel Quarter Common Intermediate Format (QCEF) and 128x96 

217" pixel Sub-QCIF (SQCIF) video sequences at 10 frames/s using a reconfigurable Time Division Multiple 

21B Access / Code Division Multiple Access (TDMA / CDMA) transceiver, which can be configured as a 1 , 

219^ 2 or 4 bit/symbol scheme shown in Figure 2. The H.263 video codec exhibits an impressive compression 

220 ratio, although this is achieved at the cost of a high vulnerability to transmission errors, since a run-length 

221 coded stream is rendered undecodable by a single bit error. In order to mitigate this problem, when the 
zz channel codec protecting the video stream is overwhelmed by the transmission errors, we refrain from 
223 decoding the corrupted video packet in order to prevent error propagation through the reconstructed video 
22« frame buffer [2}. We found that it was more beneficial in video quality terms, if these corrupted video 

225 packets were dropped and the reconstructed frame buffer was not updated, until the next video packet 

226 replenishing the specific video frame area was received. The associated video performance degradation 

227 was found perceptually unobjectionable for packet dropping- or transmission frame error rates (FER) 
22B below about 5%. These packet dropping events were signalled to the remote decoder by superimposing 

229 a strongly protected one-bit packet acknowledgement flag on the reverse-direction packet, as outlined 

230 in [2]. Bose-Chaudhuri-Hocquenghem (BCH) and turbo error correction codes were used and again, 

231 the CDMA transceiver was capable of transmitting 1, 2 and 4 bits per symbol, where each symbol was 

232 spread using a low spreading factor (SF) of 16, as seen in Table 1. 
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Parameter 




Multiple access 


TDMA/CDMA 


Channel type 


COST 207 Bad Urban 


Number of paths in channel 


7 


Normalised Doppler frequency 


3.7 x 10" 5 


CDMA spreading factor 


16 


Spreading sequence 


Random 


Frame duration 


4.615 ms 


Burst duration 


577 us 


Joint detection CDMA receiver 


Whitening matched filter (WMF) or Minimum 
mean square error block decision feedback 
equalizer (MMSE-BDFE) 


No. of Slots/Frame 


8 


TDMA frame length 


4.615ms 


TDMA slot length 


577ms 


TDMA slots/Video packet 


3 


Chip Periods/TDMA slot 


1250 


Data Symbols/TDMA slot 


68 


User Data Symbol Rate (kBd) 


14.7 


System Data Symbol Rate (kBd) 


117.9 



Table 1: Generic system parameters using the Frames spread speech/data mode 2 proposal [II] 



^233 The associated parameters will be addressed in more depth during our further discourse. Employing 

234 a low spreading factor of 16 allowed us to improve the system's multi-user performance with the aid 

235 of joint-detection techniques [21]. We note furthermore that the implementation of the joint detection 
238 receivers is independent of the number of bits per symbol associated with the modulation mode used, 

237 since the receiver simply inverts the associated system matrix and invokes a decision concerning the 

238 received symbol, irrespective of how many bits per symbol were used. Therefore, joint detection 

239 receivers are amenable to amalgamation with the above 1, 2 and 4 bit/symbol modem, since they 

240 do not have to be reconfigured each time the modulation mode is switched. 

2«t In this performance study we used the Pan-European FRAMES proposal [1 1 ] as the basis for our CDMA 

242 system. The associated transmission frame structure is shown in Figure 3, while a range of generic system 
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Features 


BCH coding 


Turbo coding 


Modulation 


4QAM 


Transmission bitrate (kbit/s) 


29.5 


Video-rate (kbit/s) 


13.7 


11. 1 


Video framerate (Hz) 


10 



Table 2: FEC-protected and unprotected BCH and Turbo coded bitrates for the 4QAM transceiver mode 

2*3 parameters are summarised in Table 1. In our performance studies we used the COST207 seven-path bad 

2« urban (BU) channel model, whose impulse response is portrayed in Figure 4. 

24$ Our initial experiments compared the performance of a whitening matched filter (WMF) for single user 

? 46 detection and the Minimum mean square error block decision feedback equalizer (MMSE-BDFE) for 

•47 joint multi-user detection. These simulations were performed using 4-level Quadrature Amplitude Mod- 

248 ulation (4QAM) t transmitting both binary BCH and turbo coded video packets. The associated bitrates 

249 are summarised in Table 2. 

250 The transmission bitrate of the 4QAM modem mode was 29.5Kbps, which was reduced due to the ap- 

251 proximately half-rate BCH or turbo coding, plus the associated video packet acknowledgement feedback 

252 Mag error control and video packetisation overhead to produce effective video bitrates of 13.7Kbps and 
253- 1 1 . 1Kbps, respectively. A more detailed discussion on the video packet acknowledgement feedback 
2S4 t error control and video packetisation overhead will be provided in Section 3.4 with reference to the 
2ss - convolutionally coded multi-mode investigations. 

2sa Figure 5 portrays the bit error ratio (BER) performance of the BCH coded video transceiver using both 

257 matched filtering and joint detection for 2-8 users. The bit error ratio is shown to increase, as the number 

:.«58 of users increases, even upon employing the MMSE-BDFE multi-user detector (MUD). However, while 

259 the matched filtering receiver exhibits an unacceptably high BER for supporting perceptually unimpaired 

2«o video communications, the MUD exhibits a far superior BER performance. 

28i When the BCH codec was replaced by the turbo-codec, the bit error ratio performance of both matched 

262 filtering and the MUD receiver improved, as shown in Figure 6. However, as expected, matched filtering 

zsa was still outperformed by the joint detection scheme for the same number of users. Furthermore, the 

264 matched filtering performance degraded rapidly for more than two users. 

265 Figure 7 shows the video packet loss ratio (PLR) for the turbo coded video stream using matched filtering 
2«fl and joint detection for 2-8 users. The figure clearly shows that the matched filter was only capable of 
267 meeting the target packet loss ratio of 5% for upto four users, when the channel SNR was in excess of 
2&a I IdB. However, the joint detection algorithm guaranteed the required video packet loss ratio performance 
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Features 


j| Multi-rate System 


Mode 


BPSK 


4QAM 


16QAM 


Bits/Symbol 


I 


2 


4 


FEC 


Convolution^ Coding 


Transmitted bits/packet 


204 


408 


816 


Total bitrate (kbit/s) 


14.7 


29.5 


58.9 


FEC-coded bits/packet 


102 


204 


408 


Assigned to FEC-coding (kbit/s) 


7.4 


14.7 


29.5 


Error detection per packet 


16 bit CRC 


Feedback bits / packet 


9 


Video packet size 


77 


179 


383 


Packet header bits 


8 


9 


10 


Video bits/packet 


69 


170 


373 


Unprotected video-rate (kbit/s) 


5.0 


123 


26.9 


Video framerate (Hz) 


10 



Table 3: Operational-mode specific transceiver parameters for the proposed multi-mode system 

269 for 2-8 users in the entire range of channel SNRs shown. Furthermore, the 2-user matched-filtered PLR 

270 performance was close to the 8-user MUD PLR. 

en 3.4 Multi-mode Video System Performance 

*m Having shown that joint detection can substantially improve our system's performance, we investigated 

i73 the performance of a multi-mode convolutionally coded video system employing joint detection, while 

274 supporting two users. The associated convolutional codec parameters are summarised in Table 3. 

275 Below we now detail the video packetisation method employed. The reader is reminded that the number 

276 of symbols per TDMA frame was 68 according to Table 1. In the 4QAM mode this would give 136 bits 

277 per TDMA frame. However, if we transmitted one video packet per TDMA frame, then the packetisation 
27B overhead would absorb a large percentage of the available bitrate. Hence we assembled larger video 
279 packets, thereby reducing the packetisation overhead and arranged for transmitting the contents of a 
2 eo video packet over three consecutive TDMA frames, as indicated in Table 1. Therefore each protected 
28t video packet consists of 68 x 3 = 204 modulation symbols, yielding a transmission bitrate of between 
2B2 14.7 and 38.9 Kbps for BPSK and 16QAM, respectively. However, in order to protect the video data 
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we employed half-rate, constraint-length nine conventional coding, using octal generator polynomials 

-84 or* 561 and 753. The useful video bitrate was further reduced due to the 16-bit Cyclic Redundancy 

:as Checking (CRC) used for error detection and the nine-bit repetition-coded feedback error Mas for the 

2B6 reverse link. This results in video packet sizes of 77. 179 and 383 bits for each of the three modulation 

287 modes. The useful video capacity was finally further reduced by the video packet header of between 8 

288 and 10 bits, resulting in useful or effective video bitrates ranging from 5 to 26.9 Kbps in the BPSK and 

289 16QAM modes, respectively. 

2M The proposed multi 7 mode system can switch amongst the 1, 2 and 4 bit/symbol modulation schemes 

291 under network control, based upon the prevailing channel conditions. As seen in Table 3, when the 

292 channel is benign, the unprotected video bitrate will be approximately 26.9Kbps the 16QAM mode. 
»3 However, as the channel quality degrades, the modem will switch to the BPSK mode of operation, where 
j* the video bitrate drops to 5Kbps, and for maintaining a reasonable video quality, the video resolution has 
»s to be reduced to SQCIF (128x96 pels). 

2M Figure 8 portrays the packet loss ratio for the multi-mode system, in each of its modulation modes for a 

29? range of channel SNRs. It can be seen in the figure that above a channel SNR of !4dB the I6QAM mode 

298 offers an acceptable packet loss ratio of less than 59o t while providing an unprotected video rate of about 

299 26.9Kbps. If the channel SNR drops below 14dB, the multi-mode system is switched to 4QAM and 
mm eventually to BPSK, when the channel SNR is below 9dB, in order to maintain the required quality of 
aoi service, which is dictated by the packet loss ratio. The figure also shows the acknowledgement feedback 
M2 error ratio (FBER) for a range of channel SNRs, which has to be substantially lower, than the video 
303 PUR itself. This requirement is satisfied in the figure, since the feedback errors only occur at extremely 
aw low channel SNRs, where the packet loss ratio is approximately 50%, and it is therefore assumed that 

the multi-mode system would have switched to a more robust modulation mode, before the feedback 

306 acknowledgement flag can become corrupted. 

307 The video quality is commonly measured in terms of the peak-signal-to-noise-ratio (PSNR). Figure 9 
3oa shows the video quality in terms of the PSNR versus the channel SNRs for each of the modulation 
309 modes. As expected, the higher throughput bitrate of the 16QAM mode provides a better video quality, 
aio However, as the channel quality degrades, the video quality of the 16QAM mode is reduced and hence 
3M it becomes beneficial to switch from the 16QAM mode to 4QAM at an SNR of about !4dB, as it was 
3t2 suggested by the packet loss ratio performance of Figure 8. Although the video quality expressed in 
3t3 terms of PSNR is superior for the 16QAM mode in comparison to the 4QAM mode at channel SNRs 
3w in excess of 12dB, however, due to the excessive PLR the perceived video quality appears inferior in 
3is comparison to that of the 4QAM mode, even though the 16QAM PSNR is higher for channel SNRs 
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316 in the range of I2-I4dB. More specifically, we found that it was beneficial to switch to a more robust 

317 modulation scheme, when the PSNR was reduced by about IdB with respect to its unimpaired PSNR 

318 value. This ensured that the packet losses did not become subjectively apparent, resulting in a higher 

319 perceived video quality and smoother degradation, as the channel quality deteriorated. 

320 The effect of packet losses on the video quality quantified in terms of PSNR is portrayed in Figure 10. 

321 The figure shows, how the video quality degrades, as the PLR increases. It has been found that in order 

322 to ensure a seamless degradation of video quality as the channel SNR reduced, it was the best policy 

323 to switch to a more robust modulation scheme, when the PLR exceeded 5%. The figure clearly shows 

324 that a 5% packet loss ratio results in a loss of PSNR, when switching to a more robust modulation 

325 scheme. However, if the system did not switch until the PSNR of the more robust modulation mode 

326 was similar, the perceived video quality associated with the originally higher rate, but channel-impaired 
jci stream became inferior. 

328 3.5 Bursf>by-Burst adaptive videophone system 

329 A burst-by-burst adaptive modem, maximizes the system's throughtput by using the most appropriate 

330 modulation mode for the current instantaneous channel conditions. Figure 1 1 exemplifies, how a burst- 

331 by-burst adaptive modem changes its modulation modes based on the fluctuating channel conditions. The 

332 adaptive modem uses the SINR estimate at the output of the joint-detector to estimate the instantaneous 

333 channel quaJity, and hence to set the modulation mode. 

334 The probability of the adaptive modem using each modulation mode for a particular channel SNRs is 

335 portrayed in Figure 12. It can be seen at high channel SNRs that the modem mainly uses the 16QAM 

336 modulation mode, while at low channel SNRs the BPSK mode is most prevalent 

J? The advantage of dynamically reconfigured burst-by-adaptive modem over the statically switched multi- 

33a mode system previously described, is that the video quality is smoothly degraded as the channel condi- 

339 tions deteriorate. The switched multi-mode system results in more sudden reductions in video quality, 

3«o when the modem switches to a more robust modulation mode. Figure 13 shows the throughput bitrate 

3*i of the dynamically reconfigured burst-by-burst adaptive modem, compared to the three modes of the 

3*2 statically switched multi-mode system. The reduction of the fixed modem modes' effective throughput 

343 at low SNRs is due to the fact that under such channel conditions an increased fraction of the transmitted 

344 packets have to be dropped, reducing the effective throughtput. The figure shows the smooth reduction of 

34 5 the throughput bitrate, as the channel quality deteriorates. The burst-by-burst modem matches the BPSK 

346 mode's bitrate at low channel SNRs, and the 16QAM mode's bitrate at high SNRs. The dynamically 

347 reconfigured burst-by-burst adaptive modem characterised in the figure perfectly estimates the prevalent 
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:ua channel conditions although in practice the estimate of channel quality is not perfect and it is inherently 

a** delayed. However, we have found that non-perfect channel estimates result in only slightly reduced 

3so performance, when compared to perfect channel estimation. 

351 The smoothly varying throughput bitrate of the burst- by -burst adaptive modem translates into a smoothly 

ass varying video quality as the channel conditions change. The video quality measured in terms of the 

353 average peak signal to noise ratio (PSNR) is shown versus the channel SNR in Figure 14 in contrast to 

354 that of the individual modem modes. The figure demonstrates that the burst-by-burst adaptive modem 

355 provides equal or better video quality over a large proportion of the SNR range shown than the individual 
3se modes. However, even at channel SNRs, where the adaptive modem has a slightly reduced PSNR, the 
357 perceived video quality of the adaptive modem is better since the video packet loss rate is far lower, than 
35a that of the fixed modem modes. 

,9 Figure 15 shows the video packet loss ratio versus channel SNR for the three fixed modulation modes 

360 and the burst- by -burst adaptive modem with perfect channel estimation. Again the figure demonstrates 

set that the video packet loss ratio of the adaptive modem is similar to that of the fixed BPSK modem mode, 

362 however the adaptive modem has a far higher bitrate throughput, as the channel SNR increases. The 

sea burst-by-burst adaptive modem gives an error performance similar to that of the BPSK mode, but with 

364 the flexibity to increase the bitrate throughput of the modem, when the channel conditions improve. If 

36s imperfect channel estimation is used, the throughput bitrate of the adaptive modem is reduced slightly. 

366 Furthermore, the video packet loss ratio seen in Figure 15 is slightly higher for the AQAM scheme due 

367 tojnvoking higher-order modem modes, as the channel quality increases. However we have found that 
sea is possible to maintain the video packet loss ratio within tolerable limits for the range of channel SNRs 
369 considered. 

o The interaction between the video quality measured in terms of PSNR and the video packet loss ratio 

371 can be more clearly seen in Figure 16. The figure shows that the adaptive modem slowly degrades 

3?2 the decoded video quality from that of the error free 16QAM fixed modulation mode, as the channel 

373 conditions deteriorate. The video quality degrades from the error- free 4idB PSNR, while maintaining a 

374 near- zero video packet loss ratio, until the PSNR drops below about 36dB PSNR. At this point the further 
37s reduced channel quality inflicts an increased video packet loss rate and the video quality degrades more 

376 slowly. The PSNR versus packet loss ratio performance then tends toward that achieved by the fixed 

377 BPSK modulation mode. However the adaptive modem achieved better video quality than the fixed 
37 B BPSK modem even at high packet loss rates. 
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a™ 3.6 Summary 

3ao A joint-detection assisted multimode CDMA-based video transceiver was proposed, which substantially 

oat outperformed the conventional matched- filtering based transceiver, which was characterised by adap- 

382 tively reconfiguring the transceiver's mode of operation based on the instantaneous channel quality. In 

aaa our transceiver a higher number of bits per modulation symbol was invoked by the transmitter, when 

384 the channel quality was sufficiently high for supporting this more bitrate efficient, but less error resilient 

aas transmission mode. By contrast, a more error resilient but less bitrate efficient mode was invoked for 

see supporting error-free CDMA transmission over wireless multi-user channels. 

as? In this embodiment the above property was exploited in a practical adaptive video transceiver, which 

sea instructed the video codec to generate the required number of bits that the CDMA transceiver was capable 

389 of delivering in its current channel-condition dependent configuration mode. 

390 In other embodiments the proposed burst-by-burst adaptive transceiver can be invoked in the context 
sat of arbitrary multimedia signals, irrespective of their resolution or source representation quality. Spe- 

392 cific further embodiments of such codecs are constituted by programmable- rate speech, audio, video, 

393 handwriting codecs, which can be configured by the transceiver to generate a channel-quality dependent 

394 number of source-coded bits. 

39s The proposed burst-by- burst adaptive video transceiver guaranteed a near-unimpaired video quality for 

396 channel SNRs in excess of about 5 dB over the COST207 dispersive Ray lei gh- faded channel. The ben- 

397 eflts of the multimode video transceiver clearly manifest themselves in terms of supporting un-impaired 

398 video quality under time-variant channel conditions, where a single-mode transceiver's quality would 

399 become severely degraded by channel effects. The dynamically reconfigured burst-by -burst adaptive 
-too modem gave better perceived video quality due to its more graceful reduction in video quality, as the 

r .-oi channel conditions degraded, than a statically switched multi-mode system. 
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CLAIMS 

I. A method for CDMA transmission of a multimedia signal over a transmission 

medium, the method comprising: 

providing a transmitter operable to transmit in a plurality of modulation modes 
5 varying in bit rate and error resilience between a highest bit rate, lowest error 

resilience mode and a lowest bit rate, highest error resilience mode; 

obtaining a channel quality measure for current transmission; and 

switching to a more or less error resilient modulation mode each time the 

channel quality measure respectively degrades or improves by a defined amount, 
10 whereby multimedia signal quality varies smoothly with varying channel quality of the 

transmission medium. 

2. A method according to claim 1, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

15 

3. A method according to claim 2, wherein the defined amount is set with 
reference to an unimpaired signal-to-noise value. 

4. A method according to claim 2 or 3, wherein the signal-to-noise value is a peak 
20 signal-to-noise ratio for a multimedia video signed. 

5. A method according to claim 2 or 3, wherein the signal-to-noise value is a 
segmental signal-to-noise ratio for a multimedia speech signal. 

25 6. A method according to claim 1, wherein the channel quality measure is a 
packet loss value. 

7. A method according to claim 1, wherein the packet loss value is varied 
dependent upon desired multimedia signal quality. 

30 
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8. A method according to claim I, wherein the channel quality measure is a bit 
error rate. 

9. A method according to any one of claims 1 to 8, wherein the channel quality 
5 measure is based on monitoring signal integrity at a remote receiver. 

10. A method according to any one of claims 1 to 8, wherein the channel quality 
measure is based on monitoring signal integrity at a receiver local to the transmitter. 

10 11. A transmitter for transmission of a multimedia source signal over a 
transmission medium to a remote receiver, the transmitter comprising a CDMA 
modem having an output for transmitting a multimedia source signal and an input for 
receiving a channel quality measure for current transmission, wherein the CDMA 
modem is switchable between a plurality of modulation modes varying in bit rate and 

15 error resilience between a highest bit rate, lowest error resilience mode and a lowest bit 
rate, highest error resilience mode, such that the CDMA modem is switched to a more 
or less error resilient modulation mode each time the channel quality measure 
respectively degrades or improves by a defined amount, whereby multimedia signal 
quality is smoothly variable with varying channel quality of the transmission medium. 

20 

12. A transmitter according to claim 11, wherein the channel quality measure is a 
multimedia signal quality dependent signal-to-noise value. 

13. A transmitter according to claim 12, wherein the defined amount is set with 
25 reference to an unimpaired signal-to-noise value. 

14. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a peak signal-to-noise ratio for a multimedia video signal. 

30 15. A transmitter according to claim 12 or 13, wherein the signal-to-noise value is 
a segmental signal-to-noise ratio for a multimedia speech signal. 
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16. A transmitter according to claim 11, wherein the channel quality measure is a 
packet loss value. 

17. A transmitter according to claim 11, wherein the packet loss value is variable 
5 dependent upon desired multimedia signal quality. 

18. A transmitter according to claim 11, wherein the channel quality measure is a 
bit error rate. 

10 19. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a remote receiver. 

20. A transmitter according to any one of claims 11 to 18, wherein the channel 
quality measure is based on monitoring signal integrity at a receiver local to the 

15 transmitter. 

21. A transmission system for transmission of multimedia source signals over a 
transmission medium, the system comprising: 

a first transceiver including a local receiver and a local transmitter according to 
20 any one of claims 11 to 20; and 

a second transceiver including a remote receiver and a remote transmitter 
according to any one of claims 1 1 to 20. 
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